Data processing device, data processing system and method

ABSTRACT

A data processing device includes a data selector circuit that divides a plurality of types of data into another plurality of types of data in accordance with a classification of the data, a plurality of compression circuits that respectively compress the plurality of types of data in parallel with each other in accordance with each of the plurality of types of data, and a data transmission circuit that transmits the plurality of types of compressed data to a terminal.

The present application is a Continuation Application of U.S. patentapplication Ser. No. 14/915,621 filed on Feb. 29, 2016, which is basedon International Application No. PCT/JP2015/001374, filed on Mar. 12,2015, the entire contents of which are incorporated herein by reference.

TECHNICAL FIELD

The present invention relates to a data processing device, a dataprocessing system and method and, for example, relates to a dataprocessing device, a data processing system and method that compress andtransmit data.

BACKGROUND ART

In order to increase the efficiency of data transmission when acquiringdata and transmitting the acquired data to a terminal, a technique thatcompresses the data to reduce the amount of data and transmits thecompressed data is used. For example, image data is acquired from adevice such as a camera, and the image data is compressed andtransmitted to a terminal. An example of application of this techniqueis displaying an image taken by an in-vehicle camera such as a backmonitor or a top view monitor of an automobile or the like on a displayor the like. In such a technique, it is necessary to reduce a time lagbetween the timing when an image is captured by the camera and thetiming when the image is displayed on the display (to reduce latency).In this case, it is possible to increase the transmission speed from thecamera to the display by compressing and transmitting the image datafrom the camera.

In relation to the above technique, Patent Literature 1 discloses animage transmission device that can transmit image data to a network andstore the image data in HDD at the same time by an encoding circuit anda compression means in a single system. Because the technique disclosedin Patent Literature 1 sorts the compressed data in order of compressionand stores them in a compressed data storage means, and then reads thecompressed data from the compressed data storage means in response to arequest from a terminal, it is possible to transmit individualcompressed data to each terminal.

CITATION LIST Patent literature

PTL1: Japanese Unexamined Patent Publication No 2003-299076

SUMMARY OF INVENTION Technical Problem

Recently, it has become possible to transmit a plurality of types ofdata, such as image data and other data (e.g., distance data), from adevice like a camera. It is thus required to transmit a plurality oftypes of data to a terminal with low latency,

However, according to the technique disclosed in Patent Literature 1,because there is only one path for compression, only one data can becompressed at a time. Thus, in the technique disclosed in PatentLiterature 1, there is a possibility that latency may be degraded when aplurality of types of data are being transferred.

The other problems and novel features of the present invention willbecome apparent from the description of the specification and theaccompanying drawings.

Solution to Problem

According to one embodiment, a data processing device includes a dataselector circuit that divides a group of data including a plurality oftypes of data into the plurality of types of data, a plurality ofcompression circuits that compress the plurality of types of data inparallel with each other in accordance with each of the plurality oftypes of data, and a data transmission circuit that transmits theplurality of types of compressed data to a terminal.

Advantageous Effects of Invention

According to the embodiment described above, it is possible to transfera plurality of types of data with low latency.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a view showing the overview of a data processing deviceaccording to an embodiment;

FIG. 2 is a view showing a data processing system according to a firstembodiment;

FIG. 3 is a flowchart showing a data processing method in the dataprocessing device according to the first embodiment;

FIG. 4 is a view showing a data processing system according to a firstalternative example of the first embodiment;

FIG. 5 is a view showing a data processing system according to a secondalternative example of the first embodiment;

FIG. 6 is a view showing a data processing system according to a thirdalternative example of the first embodiment;

FIG. 7 is a view showing a data processing system according to a secondembodiment;

FIG. 8 is a flowchart showing a data processing method in the dataprocessing device according to the second embodiment;

FIG. 9 is a view showing a data processing system according to a firstalternative example of the second embodiment;

FIG. 10 is a view showing a data processing system according to a thirdembodiment; and

FIG. 11 is a view showing an example where the data processing systemaccording to the third embodiment is mounted on an automobile.

DESCRIPTION OF EMBODIMENTS

Embodiments of the invention will be described hereinbelow. Thefollowing description and the attached drawings are appropriatelyshortened and simplified to clarify the explanation. In the figures, theidentical reference symbols denote identical structural elements and theredundant explanations thereof are omitted.

In the following embodiments, the description will be divided into aplurality of sections or embodiments when necessary for the sake ofconvenience. However, unless explicitly specified otherwise, thosesections or embodiments are by no means unrelated to each other, but arein such a relation that one represents a modification, a detailed orsupplementary description, etc. of a part or whole of the other.Further, in the following embodiments, when a reference is made to thenumber etc, (including the number, numeric value, quantity, range, etc.)of elements, except in such cases where it is explicitly specifiedotherwise or the number is obviously limited to a specific number inprinciple, the number is not limited to the specific number but may begreater or less than the specific number.

It is needless to mention that, in the following embodiments, theirconstituent elements (including operation steps) are not necessarilyessential, except in such cases where it is explicitly specifiedotherwise or they are obviously considered to he essential in principle.Likewise, in the following embodiments, when a reference is made to theshape, relative position, etc. of a constituent element or the like,this includes those shapes etc. substantially resembling or similar tothat shape etc., except in such cases where it is explicitly specifiedotherwise or it is obviously considered otherwise in principle. The sameapplies to the number etc, (including the number, numeric value,quantity, range, etc.) mentioned above.

Further, elements that are shown as functional blocks for performingvarious kinds of processing in the drawings may be configured by a CPU(Central Processing Unit), memory or another circuit as hardware or maybe implemented by a program loaded into memory or the like as software.It would thus be obvious to those skilled in the art that thesefunctional blocks may be implemented in various forms such as hardwareonly, software only or a combination of these, and not limited to eitherone.

Further, the above-described program can be stored in and provided tothe computer using any type of non-transitory computer readable medium.The non-transitory computer readable medium includes any type oftangible storage medium. Examples of the non-transitory computerreadable medium include magnetic storage media (such as floppy disks,magnetic tapes, hard disk drives, etc.), optical magnetic storage media(e.g. magneto-optical disks), CD-ROM (Read Only Memory), CD-R, CD-R/W,and semiconductor memories (such as mask ROM, PROM (Programmable ROM),EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory), etc.). Theprogram may be provided to a computer using any type of transitorycomputer readable medium. Examples of the transitory computer readablemedium include electric signals, optical signals, and electromagneticwaves. The transitory computer readable medium can provide the programto a computer via a wired communication line such as an electric wire oroptical fiber or a wireless communication line.

Overview of Embodiment

Prior to describing this embodiment, an overview of this embodiment isgiven hereinafter. FIG. 1 is a view showing the overview of a dataprocessing device 1 according to an embodiment. As shown in FIG. 1, thedata processing device 1 includes a data selector circuit 2, a firstcompression circuit 4 a, a second compression circuit 4 b, and a datatransmission circuit 6. Note that, although two compression circuits(the first compression circuit 4 a and the second compression circuit 4b) are shown in FIG. 1, the number of compression circuits may be threeor more. Further, although, for example, the first compression circuit 4a performs irreversible compression and the second compression circuit 4b performs reversible compression, it is not limited thereto. The firstcompression circuit 4 a may perform reversible compression and thesecond compression circuit 4 b may perform irreversible compression.Further, both the first compression circuit 4 a and the secondcompression circuit 4 b may perform irreversible compression, or both ofthem may perform reversible compression.

The data selector circuit 2 divides a group of data a including aplurality of types of data into a plurality of types of data b1 and c1.The first compression circuit 4 a and the second compression circuit 4 bcompress the plurality of types of data b1 and c1 in parallel with eachother in accordance with each type of the plurality of types of data b1and c1. To be specific, the first compression circuit 4 a compresses thedata b1 and obtains compressed data b2. The second compression circuit 4b compresses the data c1 and obtains compressed data c2.

The data transmission circuit 6 transmits the plurality of types ofcompressed data to a terminal. Specifically, the data transmissioncircuit 6 transmits the compressed data b2 and the compressed data c2 tothe terminal. The data transmission circuit 6 may transmit thecompressed data b2 and the compressed data c2 at the same timing or atdifferent timings.

Because the data processing device 1 according to this embodimentdivides a group of data a including a plurality of types of data inaccordance with the type of data and compresses the divided data inparallel with each other, latency when transmitting them to the terminalis improved. Thus, the data processing device 1 according to thisembodiment can transfer a plurality of types of data with low latency.

For example, in a driving support system such as a back monitor or a topview monitor of an automobile or the like, it is required to transferdata from a camera to a display with low latency (with a smalldifference between the actual motion and the motion when camera imagesare displayed on a display or the like). Further, there is an increasingneed to acquire not only surrounding images but also data such as adistance to an object or a person in the vicinity of an automobile atthe same time, as in an automatic braking system or a cruise controlsystem. As described above, because the data processing device 1according to this embodiment can transfer a plurality of types of datawith low latency, it can be effectively applied to the above system.

First Embodiment

FIG. 2 is a view showing a data processing system 10 according to afirst embodiment. The data processing system 10 includes a camera 100, adata processing device 110 and a receiving terminal 120 (receivingterminals 120 a, 120 b and 120 c). The data processing device 110 isconnected to be able to communicate with the receiving terminal 120through a communication line 50 such as, for example, a bus. The dataprocessing device 110 includes a data selector circuit 111, a reversiblecompression circuit 112, an irreversible compression circuit 113, amemory 114, and a data transmission circuit 115.

The camera 100 can output a plurality of different types of data at thesame timing. Specifically, the camera 100 outputs a group of dataincluding a plurality of different types of data. In this embodiment,the camera 100 outputs camera data A1 as a group of data to the dataprocessing device 110. The camera data A1 is image data such as, forexample, YUV color image data, IR (infrared) image data, distance dataand the like. Although the camera data A1 is transmitted through onedata bus in this example, the number of data buses is not limited. Thecamera 100 further outputs a data control signal A2 related to thecamera data A1 to the data processing device 110. The data controlsignal A2 is described later.

The data selector circuit 111 divides data that is output from thecamera 100 from which the data is transmitted based on the data controlsignal A2. To be specific, the data selector circuit 111 analyzes thecamera data A1 by a predetermined setting and divides it into data B1for which reversible compression is effective and data C1 for whichirreversible compression is effective. The data for which reversiblecompression is effective is data that is required not to vary before andafter compression. On the other hand, the data for which irreversiblecompression is effective is data that is allowed to vary before andafter compression, and thus the compressibility of this data canincrease by irreversible compression.

The reversible compression circuit 112 and the irreversible compressioncircuit 113 are circuits for performing reversible compression andirreversible compression, respectively, on each of the divided data. Thereversible compression circuit 112 and the irreversible compressioncircuit 113 perform compression in parallel with each other respectivelyon a plurality of types of divided data. Note that, although the dataprocessing device 110 includes the reversible compression circuit 112and the irreversible compression circuit 113 in this embodiment, it isnot limited thereto. Both of the two compression circuits may performreversible compression, or both of them may perform irreversiblecompression,

The reversible compression circuit 112 performs compression on the dataB1 in a reversible compression format (e.g., Zip, gzip etc.). Then, thereversible compression circuit 112 stores the obtained compressed dataB2 in the memory 114. At this time, the reversible compression circuit112 outputs a data transmission request signal R1 that reports thecompletion of compression to the data transmission circuit 115. The datatransmission request signal R1 contains information that specifies anarea where the compressed data B2 is stored in the memory 114.

The irreversible compression circuit 113 performs compression on thedata C1 in an irreversible compression format (e.g., JPEG, MPEG-2 etc.).Then, the irreversible compression circuit 113 stores the obtainedcompressed data C2 in the memory 114. At this time, the irreversiblecompression circuit 113 outputs a data transmission request signal R2that reports the completion of compression to the data transmissioncircuit 115. The data transmission request signal R2 containsinformation that specifies an area where the compressed data C2 isstored in the memory 114.

The data transmission circuit 115 receives the data transmission requestsignal R1 from the reversible compression circuit 112 and then reads thecompressed data B2 from the memory 114. To be specific, the datatransmission circuit 115 reads the compressed data B2 from the area thatis specified by the data transmission request signal R1 in the memory114. Then, the data transmission circuit 115 transmits the readcompressed data B2 to the receiving terminal 120 through thecommunication line 50. Likewise, the data transmission circuit 115receives the data transmission request signal R2 from the irreversiblecompression circuit 113 and then reads the compressed data C2 from thememory 114. To be specific, the data transmission circuit 115 reads thecompressed data C2 from the area that is specified by the datatransmission request signal R2 in the memory 114. Then, the datatransmission circuit 115 transmits the read compressed data C2 to thereceiving terminal 120 through the communication line 50.

The data transmission circuit 115 may transmit the compressed data B2and the compressed data C2 separately from each other. Specifically, forexample, the data transmission circuit 115 may transmit the compresseddata B2 upon receiving the data transmission request signal R1 and thentransmit the compressed data C2 upon receiving the data transmissionrequest signal R2 after that. In this manner, the data transmissioncircuit 115 may transmit the compressed data sequentially to thereceiving terminal 120. Further, the data transmission circuit 115 cantransmit a plurality of frames at the same time. Note that the datatransmission circuit 115 may transmit the compressed data B2 and thecompressed data C2 at the same time. Specifically, the data transmissioncircuit 115 may store the compressed data B2 and the compressed data C2in one or more communication frames and transmit these communicationframes at the same time. In this case, the data transmission circuit 115may include a buffer for storing data that has been previouslycompressed.

The receiving terminal 120 is a control chip or a computer (PC) towhich, for example, a display is connected. The receiving terminal 120receives the compressed data B2 and the compressed data C2 transmittedfrom the data processing device 110. Then, the receiving terminal 120decompresses the compressed data B2 and C2 to the original data B1 andC1 and performs necessary processing such as displaying image data on adisplay.

A flow of a process of the data processing device 110 is describedhereinafter,

FIG. 3 is a flowchart showing a data processing method in the dataprocessing device 110 according to the first embodiment. First, the dataselector circuit 111 divides the camera data A1 that includes aplurality of different types of data by each type of data based on thedata control signal A2 (S100).

Next, when the divided data is data requiring reversible compression(YES in S101), the data processing device 110 performs reversiblecompression on the data (S102 a). On the other hand, when the divideddata is data not requiring reversible compression (NO in S101), the dataprocessing device 110 performs irreversible compression on the data(S102 b). To be specific, the data selector circuit 111 divides thecamera data A1 into the data B1 for which reversible compression iseffective and the data C1 for which irreversible compression iseffective. Then, the data selector circuit 111 outputs the data B1 tothe reversible compression circuit 112 and outputs the data C1 to theirreversible compression circuit 113. The reversible compression circuit112 performs reversible compression on the data B1. Further, theirreversible compression circuit 113 performs irreversible compressionon the data C1.

The data control signal A2 that is output from the camera 100 contains aValid signal indicating that the camera data A1 that is output at thesame timing as that of the output of the data control signal A2 is validdata, for example. Thus, when the data selector circuit 111 receives thedata control signal A2 containing the Valid signal, it performsprocessing on the camera data A1 that is output at the same timing asthat of the output of the data control signal A2. The data selectorcircuit 111 can thereby perform processing at an appropriate timing. Inother words, when the data selector circuit 111 receives invalid datasuch as the one output when the camera 100 is in the idle mode, canrefrain from performing processing on the data.

Further, the camera data A1 contains, for example, YUV color image data,distance data and the like, as described above. The YUV color image datais image data indicating a color image to be viewed by a user in thereceiving terminal 120. When a person views an image, even if the imagedata slightly changes before and after compression, the person hardlyrecognizes the change. Thus, because a change in data by compression haslittle influence on the YUV color image data, to perform irreversiblecompression in order to increase the compressibility is effective.Accordingly, the data selector circuit 111 classifies the YUV colorimage data as the data C1 for which irreversible compression iseffective.

On the other hand, distance data (numeric data indicating the distancefrom the camera 100 to an object) is used for a computation circuit suchas a CPU to perform calculation in the receiving terminal 120. Thus, forthe distance data, it is required that the data not change before andafter compression. Thus, to perform reversible compression on thedistance data is effective. Accordingly, the data selector circuit 111classifies the distance data as the data B1 for which reversiblecompression is effective.

Note that IR image data is used to be viewed by a user in the receivingterminal 120 in some cases and used to be computed in the receivingterminal 120 in other cases. Thus, the data selector circuit 111 mayclassify the IR image data as the data B1 or the data C1 according tothe usage in the receiving terminal 120.

Note that the data control signal A2 may contain information thatspecifies a data structure of the camera data A1. This is suitable forthe case where the camera 100 can output the data control signal A2containing such information. To be specific, when, for example, thecamera data A1 is 24 bits, the high 8 bits of the camera data A1 is thedata B1 (e.g., distance data), and the low 16 bits of the camera data A1is the data C1 (e.g., image data), the data control signal A2 maycontain information indicating that. Then, the data selector circuit 111divides the camera data A1 into the data B1 for which reversiblecompression is effective and the data C1 for which irreversiblecompression is effective by using the information that specifies thedata structure. In this configuration, the data selector circuit 111 caneasily divide the camera data A1.

Further, information that specifies the data structure of the cameradata A1 may be preset to the data selector circuit 111. To be specific,when the specifications of the camera 100 are known, information thatspecifies the structure of the camera data A1 may be set to the dataselector circuit 111 in accordance with the specifications. In thisconfiguration, there is no need to specify the data structure in thedata control signal A2. On the other hand, by specifying the datastructure in the data control signal A2, there is no need to preset theinformation to the data selector circuit 111.

The data B1 and the data C1 that are classified in the data selectorcircuit 111 are input to the reversible compression circuit 112 and theirreversible compression circuit 113, respectively. The reversiblecompression circuit 112 and the irreversible compression circuit 113that respectively receive the data B1 and the data C1 perform datacompression in accordance with the predetermined setting. Note that thetimings when the data B1 and the data C1 are respectively input to thereversible compression circuit 112 and the irreversible compressioncircuit 113 may be the same. Then, the reversible compression circuit112 and the irreversible compression circuit 113 perform the datacompression in parallel. Specifically, the processing steps of S102 aand S102 b are performed in parallel with each other.

The reversible compression circuit 112 continues the compressionprocessing until the compression is completed (NO in S103 a). When thecompression is completed (YES in S103 a) the reversible compressioncircuit 112 outputs the obtained compressed data B2 to the memory 114and writes the compressed data B2 in a predetermined area in the memory114. At this time, the reversible compression circuit 112 outputs thedata transmission request signal R1 to the data transmission circuit 115and thereby requests the data transmission circuit 115 to transmit data(S104 a).

Likewise, the irreversible compression circuit 113 continues thecompression processing until the compression is completed (NO in S103b). When the compression is completed (YES in S103 b), the irreversiblecompression circuit 113 outputs the obtained compressed data C2 to thememory 114 and writes the compressed data C2 in a predetermined area inthe memory 114. At this time, the irreversible compression circuit 113outputs the data transmission request signal R2 to the data transmissioncircuit 115 and thereby requests the data transmission circuit 115 totransmit data (S104 b). Note that the processing steps of S102 a, S103 aand S104 a are performed in parallel with the processing steps of S102b, S103 b and S104 b.

The data transmission circuit 115 starts transmission of the compresseddata input from the memory 114 (S105). To be specific, when the datatransmission circuit 115 receives the data transmission request signalR1, it extracts the compressed data B2 from the memory 114 and transmitsit to the receiving terminal 120. On the other hand, when the datatransmission circuit 115 receives the data transmission request signalR2, it extracts the compressed data C2 from the memory 114 and transmitsit to the receiving terminal 120. Note that the data transmissioncircuit 115 can transmit a plurality of frames of data to a plurality ofreceiving terminals 120 at the same time.

The time it takes for both of the two compressed data B2 and C2 to beoutput from the memory 114 to the data transmission circuit 115 isgenerally shorter than the time required for one-time compression. Thus,the data transmission circuit 115 can receive the compressed data B2 andC2 before the next compressed data are output from the reversiblecompression circuit 112 and the irreversible compression circuit 113. Itis thereby possible to prevent the data loss of the compressed data.Note that, even if the time it takes for the two compressed data B2 andC2 to he output from the memory 114 to the data transmission circuit 115is equal to or longer than the time required for one-time compression,because the memory 114 temporarily stores the compressed data, it ispossible to prevent the data loss regardless of the timing it takes totransmit the compressed data. Further, because the memory 114temporarily stores the compressed data, the data transmission circuit115 can transmit the compressed data B2 and the compressed data C2 tothe receiving terminal 120 at an arbitrary timing. For example, the datatransmission circuit 115 can transmit the compressed data B2 and thecompressed data C2 to the receiving terminal 120 at the same time.Alternatively, the data transmission circuit 115 can transmit thecompressed data B2 and the compressed data C2 to the receiving terminal120 at the timing when the receiving terminal 120 requires the data.

In the above-mentioned Patent Literature, when processing a plurality oftypes of data, until the processing of one data ends and the selector isswitched, the next data cannot be processed. Further, because during theperiod when one data is compressed, another data cannot be compressed,it takes a long time to transmit all data.

On the other hand, the data processing device 110 according to thisembodiment includes the data selector circuit 111 that divides aplurality of types of data and includes two compression circuits thatare placed in parallel with each other. In other words, there are aplurality of paths for compression in this embodiment. Accordingly, eachof a plurality of types of divided data can be compressed in parallelwith each other. It is thereby possible to reduce the latency whentransferring a plurality of types of data compared with the case where aplurality of data are sequentially compressed.

Further, the data processing device 110 according to this embodimentincludes two compression circuits that perform compression in differentcompression formats. Specifically, in this embodiment, a firstcompression circuit (the irreversible compression circuit 113 in thisembodiment) performs compression in a first format (an irreversiblecompression format in this embodiment) on a first type of data (imagedata in this embodiment). On the other hand, a second compressioncircuit (the reversible compression circuit 112 in this embodiment)performs compression in a second format reversible compression format inthis embodiment) which is different from the first format on a secondtype of data (distance data in this embodiment). In this configuration,even when a plurality of different types of data are input, it ispossible to compress these data by a compression method that is suitablefor the usage of each data in accordance with the type of the data.

Furthermore, the data processing device 110 according to this embodimentincludes the reversible compression circuit 112 and the irreversiblecompression circuit 113 in parallel with each other. In thisconfiguration, it is possible to perform compression in an irreversiblecompression format and compression in a reversible compression format inparallel with each other.

Further, because only one compression circuit is placed in theabove-mentioned Patent Literature, even when a plurality of types ofdata are input, either one of an irreversible compression format and areversible compression format can be selected. On the other hand, thedata processing device 110 according to this embodiment can process datato be viewed by a user in the receiving terminal 120 (a first type ofdata) such as image data and data to be computed in the receivingterminal 120 (a second type of data) such as distance data separatelyfrom each other. As described earlier, for the image data such as YUVcolor image data, even if the image data slightly changes before andafter compression, a person hardly recognizes the change. On the otherhand, for the distance data, because it is used for operations such ascalculation in the receiving terminal 120, it is required that the datanot change before and after compression. Therefore, the data processingdevice 110 according to this embodiment can perform irreversiblecompression on the image data so as to increase the compressibility andperform reversible compression on the distance data so as not to cause achange in the data.

Further, in the above-described embodiment, the reversible compressioncircuit 112 and the irreversible compression circuit 113 respectivelyoutput the data transmission request signals R1 and R2 to the datatransmission circuit 115, and the data transmission circuit 115transmits the compressed data based on the data transmission requestsignals R1 and R2. Stated differently, a series of data processingoperations from the compression of the data A1 input from the camera 100to the transmission of the compressed data to the receiving terminal 120are performed without using CPU processing. In this configuration, it ispossible to perform the compression of data and the transfer of data byusing hardware without any software processing such as processing by aCPU, which enables high-speed processing.

In the case where software processing by a CPU is performed, it isrequired to perform interrupt processing on the CPU when the compressionis completed. At this time, the CPU needs to perform interruptprocessing and bus access processing and access the data transmissioncircuit. On the other hand, in the configuration of this embodiment, thedata transmission request signals R1 and R2 (completion flags) aredirectly input from the reversible compression circuit 112 and theirreversible compression circuit 113 to the data transmission circuit115. This eliminates the need for the interrupt processing and the busaccess processing in the CPU, and it is thereby possible to achievehigh-speed processing.

Alternative Example of First Embodiment

FIG. 4 is a view showing the data processing system 10 according to afirst alternative example of the first embodiment. FIG. 4 illustratesthe case where three or more types of data are input to the dataprocessing device 110. To be specific, in FIG. 4, the data processingsystem 10 includes two cameras 100 a and 100 b. Further, in FIG. 4, thedata processing device 110 includes a reversible compression circuit 134in addition to the reversible compression circuit 112 and theirreversible compression circuit 113.

The camera 100 a outputs the camera data A1 including YUV color imagedata and distance data and the data control signal A2 related to thecamera data A1, just like the camera 100 in FIG. 2 does. On the otherhand, the camera 100 b outputs camera data A3 including, for example, IRimage data and a data control signal A4 related to the camera data A3.The data control signal A4 has the same structure as that of the datacontrol signal A2.

The data selector circuit 111 divides the camera data A1 into the YUVcolor image data and the distance data based on the data control signalA2 as described above. Then, the data selector circuit 111 outputs thedistance data as the data B1 to the reversible compression circuit 112and outputs the YUV color image data as the data C1 to the irreversiblecompression circuit 113. Further, the data selector circuit 111 outputsthe IR image data included in the camera data A3 as data D1 to thereversible compression circuit 134 based on the data control signal A4.Thus, in this example, the IR image data is data for which reversiblecompression is effective, i.e., the data is data to be computed in thereceiving terminal 120.

The processing operations of the reversible compression circuit 112 andthe irreversible compression circuit 113 are the same as those describedwith reference to FIG. 2 and thus are not redundantly described. Thereversible compression circuit 134 performs reversible compression onthe data D1 and stores the obtained compressed data D2 in the memory 114in the same manner as that of the reversible compression circuit 112.Further, the reversible compression circuit 134 outputs a datatransmission request signal R3 that reports the completion ofcompression to the data transmission circuit 115. The data transmissioncircuit 115 thereby transmits the compressed data D2 to the receivingterminal 120.

As described above, this embodiment is also applicable to the case wherethere are three types of data. Further, in the case where there are fouror more types of data, the compression circuit(s) may be added inparallel according to the number of types. Note that, by placing amemory in the data selector circuit 111, it is possible to perform thecompression on each of a plurality of types of data without increasingthe number of compression circuits. Note that, in the example of FIG. 4,when the IR image data is data for which irreversible compression iseffective, i.e., the data is data to be viewed by a user in thereceiving terminal 120, an irreversible compression circuit may beplaced instead of the reversible compression circuit 134. Further,although the case where there are a plurality of cameras 100 is shown inFIG. 4, the camera data A1 that includes three or more types of data maybe output from one camera 100.

FIG. 5 is a view showing the data processing system 10 according to asecond alternative example of the first embodiment. In the example ofFIG. 5, a plurality of data transmission circuits are placedrespectively for the compressed data B2 from the reversible compressioncircuit 112 and the compressed data C2 from the irreversible compressioncircuit 113. To be specific, in the example of FIG. 5, the dataprocessing device 110 includes a data transmission circuit 141 fortransmitting the compressed data B2 and a data transmission circuit 142for transmitting the compressed data C2. In the example of FIG. 5, thedata processing device 110 does not need to include the memory 114.

The reversible compression circuit 112 outputs the compressed data B2 tothe data transmission circuit 141. At this time, the reversiblecompression circuit 112 outputs the data transmission request signal R1that reports the completion of compression to the data transmissioncircuit 141. The data transmission circuit 141 receives the datatransmission request signal R1 and thereby transmits the compressed dataB2 output from the reversible compression circuit 112 to the receivingterminal 120.

The irreversible compression circuit 113 outputs the compressed data C2to the data transmission circuit 142. At this time, the irreversiblecompression circuit 113 outputs the data transmission request signal R2that reports the completion of compression to the data transmissioncircuit 142. The data transmission circuit 142 receives the datatransmission request signal R2 and thereby transmits the compressed dataC2 output from the irreversible compression circuit 113 to the receivingterminal 120.

In the example of FIG. 5, the data transmission circuit 141 fortransmitting the compressed data B2 and the data transmission circuit142 for transmitting the compressed data C2 are placed separately. Thus,even without a memory that temporarily stores the compressed data, thedata processing device 110 can transmit the compressed data B2 from thereversible compression circuit 112 and the compressed data C2 from theirreversible compression circuit 113 separately with no data loss.

FIG. 6 is a view showing the data processing system 10 according to athird alternative example of the first embodiment. In the example ofFIG. 6, a channel Ch1 and a channel Ch2 respectively for transmittingthe compressed data B2 from the reversible compression circuit 112 andthe compressed data C2 from the irreversible compression circuit 113 areplaced separately. To be specific, in the example of FIG. 6, the dataprocessing device 110 includes a data transmission circuit 150compatible with the channel Ch1 and the channel Ch2. In the example ofFIG. 6, the data processing device 110 does not need to include thememory 114.

The reversible compression circuit 112 outputs the compressed data B2 tothe data transmission circuit 150. At this time, the reversiblecompression circuit 112 outputs the data transmission request signal R1that reports the completion of compression to the data transmissioncircuit 150. The data transmission circuit 150 receives the datatransmission request signal R1 and thereby transmits the compressed dataB2 to the receiving terminal 120 through the channel Ch1.

The irreversible compression circuit 113 outputs the compressed data C2to the data transmission circuit 150. At this time, the irreversiblecompression circuit 113 outputs the data transmission request signal R2that reports the completion of compression to the data transmissioncircuit 150. The data transmission circuit 150 receives the datatransmission request signal R2 and thereby transmits the compressed dataC2 to the receiving terminal 120 through the channel Ch2.

In the example of FIG. 6, the channel Ch1 and the channel Ch2 fortransmitting the compressed data B2 and the compressed data C2,respectively, are placed separately. Thus, even without a memory thattemporarily stores the compressed data, the data processing device 110can transmit the compressed data B2 from the reversible compressioncircuit 112 and the compressed data C2 from the irreversible compressioncircuit 113 separately with no data loss.

Second Embodiment

FIG. 7 is a view showing a data processing system 20 according to asecond embodiment. In the second embodiment, the data processing systemcommunicates with a receiving terminal in a format compliant withEthernet (registered trademark).

The data processing system 20 includes a camera 100, a data processingdevice 210, and a receiving terminal 120 (receiving terminals 120 a, 120b and 120 c). The data processing device 210 is connected to be able tocommunicate with the receiving terminal 120 through a communication line52 compliant with, for example, Ethernet. The data processing device 210includes a data selector circuit 111, a reversible compression circuit112, an irreversible compression circuit 113, an Ethernet header addingcircuit 212, an Ethernet header adding circuit 213, a memory 114, and anEthernet communication circuit 215. Thus, in the second embodiment, theEthernet header adding circuit 212 and the Ethernet header addingcircuit 213 are added, and the Ethernet communication circuit 215replaces the data transmission circuit 115. The other elements are thesame as those of the first embodiment and not redundantly described.

FIG. 8 is a flowchart showing a data processing method in the dataprocessing device 210 according to the second embodiment. In FIG. 8, thedescription of the same processing steps (S100 to S103) as in the firstembodiment is omitted. The operation of each circuit of the dataprocessing device 210 is described hereinafter with reference to FIG. 8.

The reversible compression circuit 112 performs compression and outputsthe compressed data B2 to the Ethernet header adding circuit 212. TheEthernet header adding circuit 212 adds an Ethernet header related tothe compressed data B2 to the compressed data B2 (S202 a). Then, theEthernet header adding circuit 212 writes the compressed data B3 withthe Ethernet header added in a predetermined area in the memory 114. Inthe second embodiment, when the Ethernet header adding circuit 212 addsthe Ethernet header, the Ethernet header adding circuit 212 outputs thedata transmission request signal R1 to the Ethernet communicationcircuit 215. The Ethernet header adding circuit 212 thereby requests theEthernet communication circuit 215 to transmit data (S204 a).

The irreversible compression circuit 113 performs compression andoutputs the compressed data C2 to the Ethernet header adding circuit213. The Ethernet header adding circuit 213 adds an Ethernet headerrelated to the compressed data C2 to the compressed data C2 (S202 b).Then, the Ethernet header adding circuit 213 writes the compressed dataC3 with the Ethernet header added in a predetermined area in the memory114. In the second embodiment, when the Ethernet header adding circuit213 adds the Ethernet header, the Ethernet header adding circuit 213outputs the data transmission request signal R2 to the Ethernetcommunication circuit 215. The Ethernet header adding circuit 213thereby requests the Ethernet communication circuit 215 to transmit data(S204 b).

The Ethernet communication circuit 215 starts transmission of thecompressed data input from the memory 114 (S205). To be specific, whenthe Ethernet communication circuit 215 receives the data transmissionrequest signal R1, it extracts the compressed data B3 with the headerfrom the memory 114. Then, the Ethernet communication circuit 215transmits the compressed data B3 with the header to the receivingterminal 120 in a format compliant with Ethernet. On the other hand,when the Ethernet communication circuit 215 receives the datatransmission request signal R2, it extracts the compressed data C3 withthe header from the memory 114. Then, the Ethernet communication circuit215 transmits the compressed data C3 with the header to the receivingterminal 120 in a format compliant with Ethernet.

In the second embodiment, the data processing device 210 can transmitthe compressed data to the receiving terminal 120 in a format compliantwith Ethernet. Thus, for a plurality of data processing devices 210 anda plurality of receiving terminals 120 (receiving terminals 120 a, 120 band 120 c), a network configuration such as a bus type or a star typecan be constructed. Further, a cable used in Ethernet communications mayhave high tolerance to noise compared with a cable in an analog formatand a cable in a LVDS (Low voltage differential signaling) format. Thus,a shield film may not be required for the cable used in Ethernetcommunications. Therefore, by transmitting the compressed data in aformat compliant with Ethernet, the cable can be thinner, which makeswiring easy. This also allows the use of an inexpensive cable. This isparticularly effective in the case where a digital camera is connectedto the device in a vehicle or the like.

Further, in the second embodiment, an Ethernet header is added to thecompressed data. The Ethernet header contains information such as a timestamp that is defined by Ethernet (registered trademark) AVB or thelike. By using such information, when the data processing device 210receives a plurality of different camera data from a plurality ofcameras 100 and the like, it is possible to synchronize a plurality ofimage data and the like respectively contained in the plurality ofcamera data. This is particularly effective in the case where the topview monitor technology that combines a plurality of image data obtainedusing a plurality of cameras is employed.

Note that, also in the second embodiment, the reversible compressioncircuit 112 and the irreversible compression circuit 113 are placed inparallel. Thus, substantially the same advantageous effects as in thefirst embodiment are obtained in the second embodiment as well.

Alternative Example of Second Embodiment

FIG. 9 is a view showing the data processing system 20 according to afirst alternative example of the second embodiment. In FIG. 9, comparedwith FIG. 7, the positions of the memory and the Ethernet header addingcircuit are replaced.

To be specific, in the example of FIG. 9, the data processing device 210includes a memory 220 in place of the memory 114 and includes anEthernet header adding circuit 222 in place of the Ethernet headeradding circuit 212 and the Ethernet header adding circuit 213. In FIG.9, the reversible compression circuit 112 stores the compressed data B2in the memory 220 in the same manner as in the example of FIG. 2. Atthis time, the reversible compression circuit 112 outputs the datatransmission request signal R1 to the Ethernet communication circuit215. Further, after the compressed data B2 is stored in the memory 220,the Ethernet header adding circuit 222 adds an Ethernet header to thestored compressed data B2. The compressed data B3 with the Ethernetheader added is thereby stored in the memory 220.

Further, the irreversible compression circuit 113 stores the compresseddata C2 in the memory 220 in the same manner as in the example of FIG.2. At this time, the reversible compression circuit 113 outputs the datatransmission request signal R2 to the Ethernet communication circuit215. Further, after the compressed data C2 is stored in the memory 220,the Ethernet header adding circuit 222 adds an Ethernet header to thestored compressed data C2. The compressed data C3 with the Ethernetheader added is thereby stored in the memory 220.

When the Ethernet communication circuit 215 receives the datatransmission request signal R1, it extracts the compressed data B3 withthe header from the memory 220 and transmits it to the receivingterminal 120 in the same manner as in the example of FIG. 7. On theother hand, when the Ethernet communication circuit 215 receives thedata transmission request signal R2, it extracts the compressed data C3with the header from the memory 220 and transmits it to the receivingterminal 120 in the same manner as in the example of FIG. 7.

In the example of FIG. 9, only one Ethernet header adding circuit isplaced. Thus, the circuit scale can be reduced by the size correspondingto one Ethernet header adding circuit compared with the configuration ofFIG. 7.

Third Embodiment

FIG. 10 is a view showing a data processing system 30 according to athird embodiment. The third embodiment is different from the otherembodiments in that more than one data processing devices 110 accordingto the first embodiment are placed. In the third embodiment, more thanone data processing devices 210 according to the second embodiment maybe placed. In the third embodiment, a network is constructed using aplurality of data processing devices according to the first or secondembodiment.

The data processing system 30 includes camera data processing units 301,302, 303 and 304, a relay device 300, and a receiving terminal 120. Thecamera data processing unit 301 includes a camera 100 a and a dataprocessing device 110 a. Likewise, the camera data processing unit 302includes a camera 100 b and a data processing device 110 b. The cameradata processing unit 303 includes a camera 100 c and a data processingdevice 110 c. The camera data processing unit 304 includes a camera load100 d and a data processing device 110 d. The cameras 100 a, 100 b, 100c and 100 d have substantially the same functions as the camera 100shown in FIG. 2. Likewise, the data processing devices 110 a, 110 b, 110c and 110 d have substantially the same configuration as the dataprocessing device 110 shown in FIG. 2. Each of the data processingdevices 110 a, 110 b, 110 c and 110 d transmits the compressed data(compressed data B2 and C2) to the relay device 300.

The relay device 300 is, for example, a hub, a router, or a switchinghub in Ethernet or the like. The relay device 300 has the function ofrelaying the compressed data output from the data processing devices 110a, 110 b, 110 c and 110 d to the receiving terminal 120. The relaydevice 300 may transmit the compressed data output from the dataprocessing devices 110 a, 110 b, 110 c and 110 d as a bundle to thereceiving terminal 120. At this time, the compressed data of the cameradata respectively obtained at the same timing by the cameras 100 a, 100b, 100 c and 100 d may be synchronized by using the Ethernet headeraccording to the second embodiment.

In the third embodiment, a network is constructed using a plurality ofdata processing devices. Thus, various processing can be performed inthe receiving terminal 120 by using the camera data acquired by aplurality of cameras 100. An example of application of the thirdembodiment is described hereinafter.

FIG. 11 is a view showing an example where the data processing system 30according to the third embodiment is mounted on a vehicle 900. AlthoughFIG. 11 shows an example where the system is used for an in-vehicle topview system, it is not limited thereto.

The vehicle 900 includes camera data processing units 301, 302, 303 and304 and a top view receiving terminal 310. The top view receivingterminal 310 has the functions of the relay device 300 and the receivingterminal 120 shown in FIG. 10. The camera 100 a of the camera dataprocessing unit 301 takes an image of the front of the vehicle 900 andacquires the image data related to the front. Further, the camera 100 aof the camera data processing unit 301 measures the distance from anobject in front of the vehicle 900 and acquires the distance dataindicating the measured value. The data processing device 110 a of thecamera data processing unit 301 acquires camera data that contains theimage data and the distance data and performs the compression asdescribed above. Then, the data processing device 110 a transmits thecompressed data related to the front to the top view receiving terminal310.

Likewise, the camera data processing unit 302 acquires and compressesthe image data and the distance data related to the right side of thevehicle 900 and transmits the compressed data related to the right sideto the top view receiving terminal 310. The camera data processing unit303 acquires and compresses the image data and the distance data relatedto the back of the vehicle 900 and transmits the compressed data relatedto the back to the top view receiving terminal 310. The camera dataprocessing unit 304 acquires and compresses the image data and thedistance data related to the left side of the vehicle 900 and transmitsthe compressed data related to the left side to the top view receivingterminal 310.

The top view receiving terminal 310 decompresses the compressed datarelated to the above-described four directions (front, back, right sideand left side) and performs various processing. For example, the topview receiving terminal 310 combines the image data related to the fourdirections to generate an image related to the top view and displays iton a display.

Further, when there is an object (obstacle) within a certain distancefrom the vehicle 900 (camera 100) in a certain direction (for example,the left side), the top view receiving terminal 310 performs certainprocessing to warn a user of that fact. For example, in this case, thetop view receiving terminal 310 may output an alarm or change the colorof the image data related to the corresponding direction (for example,the left side). As described above, by constructing the system accordingto the third embodiment, various processing can be performed in thereceiving terminal 120.

Alternative Example

This embodiment is not limited to the above-described embodiment, andmaybe varied in many ways within the scope of the present invention. Forexample, although the data processing device includes a memory in theabove-described embodiment, it may include a data selection logicalcircuit in place of the memory. The data selection logical circuit is acircuit that receives the compressed data transmitted from a pluralityof compression circuits and transmits them to a data transmissioncircuit. The time it takes for the data selection logical circuit tooutput the data to the data transmission circuit 115 is shorter than thetime required for one-time compression, and therefore it is possible totransmit the compressed data to the data transmission circuit before thenext data is output from the compression circuit. Further, the dataselection logical circuit may transmit the compressed data to the datatransmission circuit in a different order according to setting by theinput of an external signal or the like. For example, when it is desiredto process the distance data first among the data contained in thecamera data, it is possible to transmit the distance data first evenwhen the distance data and the YUV image data are received at the sametime.

Further, although the data processing device includes the reversiblecompression circuit and the irreversible compression circuit in theabove-described embodiment, it is not limited thereto. All of aplurality of compression circuits included in the data processing devicemay be reversible compression circuits or all of them may beirreversible compression circuits.

Further, although a camera outputs a group of data including a pluralityof different types of data in the above-described embodiment, a devicethat outputs a group of data is not limited to a camera. This embodimentis applicable to any device capable of outputting a group of data. Forexample, a scanner may output a group of data, or a recording device mayoutput a group of data. In the case of a scanner, a group of data mayinclude, for example, image data obtained by scanning and dataindicating the features of the image data. Further, in the case of arecording device, a group of data may include data representing arecorded video and data related to the video (a recording time, positiondata indicating a recording place etc.).

Although embodiments of the present invention are described specificallyin the foregoing, the present invention is not restricted to theabove-described embodiments, and various changes and modifications maybe made without departing from the scope of the invention.

REFERENCE SIGNS LIST

-   1 DATA PROCESSING DEVICE-   2 DATA SELECTOR CIRCUIT-   4A FIRST COMPRESSION CIRCUIT-   4B SECOND COMPRESSION CIRCUIT-   6 DATA TRANSMISSION CIRCUIT-   10 DATA PROCESSING SYSTEM-   20 DATA PROCESSING SYSTEM-   30 DATA PROCESSING SYSTEM-   100 CAMERA-   110 DATA PROCESSING DEVICE-   111 DATA SELECTOR CIRCUIT-   112 REVERSIBLE COMPRESSION CIRCUIT-   113 IRREVERSIBLE COMPRESSION CIRCUIT-   114 MEMORY-   115 DATA TRANSMISSION CIRCUIT-   120 RECEIVING TERMINAL-   134 REVERSIBLE COMPRESSION CIRCUIT-   141 DATA TRANSMISSION CIRCUIT-   142 DATA TRANSMISSION CIRCUIT-   150 DATA TRANSMISSION CIRCUIT-   210 DATA PROCESSING DEVICE-   212 ETHERNET HEADER ADDING CIRCUIT-   213 ETHERNET HEADER ADDING CIRCUIT-   215 ETHERNET COMMUNICATION CIRCUIT-   220 MEMORY-   222 ETHERNET HEADER ADDING CIRCUIT-   300 RELAY DEVICE-   301 CAMERA DATA PROCESSING UNIT-   302 CAMERA DATA PROCESSING UNIT-   303 CAMERA DATA PROCESSING UNIT-   304 CAMERA DATA PROCESSING UNIT-   310 TOP VIEW RECEIVING TERMINAL

1. A data processing device, comprising: a data selector circuit thatdivides a plurality of types of data into another plurality of types ofdata in accordance with a classification of the data; a plurality ofcompression circuits that respectively compress the plurality of typesof data in parallel with each other in accordance with each of theplurality of types of data; and a data transmission circuit thattransmits the plurality of types of compressed data to a terminal. 2.The data processing device according to claim 1, wherein each of theplurality of compression circuits outputs a data transmission requestsignal to the data transmission circuit when a compression ends, andwherein the data transmission circuit transmits each of the plurality oftypes of compressed data to the terminal based on the data transmissionrequest signal.
 3. The data processing device according to claim 1,further comprising: a memory that stores the plurality of types of datarespectively compressed by the plurality of compression circuits.
 4. Thedata processing device according to claim 1, wherein the datatransmission circuit transmits the plurality of types of compressed datato the terminal in a format compliant with Ethernet.
 5. The dataprocessing device according to claim 4, further comprising: a headeradding circuit that adds an Ethernet header to the data respectivelycompressed by the plurality of compression circuits, wherein the datatransmission circuit transmits the data with the Ethernet header to theterminal.
 6. The data processing device according to claim 1, whereinthe data transmission circuit transmits the plurality of types ofcompressed data separately from one another.
 7. The data processingdevice according to claim 1, wherein the data selector circuit divides agroup of data when a data control signal is received from a circuitwhich has transmitted the group of data.
 8. The data processing deviceaccording to claim 7, wherein the data control signal containsinformation specifying a structure of each of the plurality of types ofdata in the group of data, and wherein the data selector circuit dividesthe group of data based on the data control signal.
 9. The dataprocessing device according to claim 1, wherein information specifying astructure of each of the plurality of types of data in a group of datais preset to the data selector circuit.